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Nonalphabetic  Characters 

'  (apostrophe  or  prime).... Designates  the  image  plane,  its  absence  the 


object  (background)  plane.  Fig.  1;  used  with 
both  coordinates  and  physical  quantities, 

|  e.g.,  l(x',y'),(x,y)J  and  Iux,ux). 

■  (identity) . Signifies  a  definition. 

;  (seed colon) . Separates  variables  from  parameters  in  an  ar¬ 

gument  list  -  ( variables ;parameters ) . 

+  (arrow) . Marks  chief  space-  and  time-domain  equations. 

•  (midline  dot) . Placed  between  factors  of  a  product  to  facil¬ 

itate  recognition. 

*  (copyright  sign) . Signifies  convolution  of  two  functions  with 

respect  to  one  variable,  i.e.,  g(x)°w(x°-x) 

■  SJZ  g(x)*w(x°-x)*dx  -  z(x#);  repetition 
indicates  multiple  convolution. 

*  (degree) . Marks  the  variable  or  parameter  of  a  convolu- 

[  tion  integral;  may  be  affixed  to  either. 

'  (grave  accent) . Denotes  sampling  by  a  comb  function. 

\  \  (backslashes) . Signify  cropping  of  an  image  in  space  and 

truncation  of  an  image  sequence  in  time. 

<  >  (angular  brackets) . Indicate  linear,  shift-invariant,  temporal 

averaging  of  sensor  output  during  temporal- 
integral  sampling. 

•  (double  arrow) . Identifies  a  fourier  transform  pair. 

(circumflex  or  hat) . Marks  vectors. 

(tilde) . Affixed  to  one  member  of  a  fourier  pair  to 

indicate  distortion  ("rippling")  due  to  trun¬ 
cation  of  the  other  member. 


Subscripts 


a . An  atmospheric  quantity. 

b . A  background  (object)  quantity. 

. . Labels  central  coordinates  of  detector  ele¬ 
ments  and  integration  intervals. 

f . "Filtered",  i.e.,  passed  through  one  or  more 

stages  of  linear,  shift-invariant,  analog 
processing. 

g . A  gaussian  (ideal  geometric-optical)  quan¬ 

tity. 


X . A  spectral  quantity,  one  resulting  from  radi¬ 

ation  in  the  infinitesimal  wavelength  range  X 
to  (X4dX);  also  a  monochromatic  quantity,  the 
value  of  a  wavelength-dependent  quantity  at 
wavelength  X. 

Latin  Letters 


a . Detector  width  (x  dimension).  Pigs.  2  and  3. 

A . Area  of  optical  aperture  stop,  Fig.  1. 

b . Detector  height  (y  dimension).  Pigs.  2  and  3. 

d . Distance  from  optical  aperture  to  object, 

Pig.  1;  also  indicates  an  infinitesimal  quan¬ 
tity,  e.g.,  dX. 

D . Diameter  of  a  circular  aperture  stop. 

f . Temporal  frequency. 

Of . Temporal  frequency  interval  (Af  -  1/At). 

AP . Temporal  frequency  interval  (AF  -  1/AT). 

Pf,. . Equivalent  focal  length  of  optics.  Pig.  1; 

Fl  -  -(x^/xb)d  -  -(y^/Yb)d. 

■iff .  . Equivalent  "FN  number  of  optics  with  a  circu¬ 

lar  aperture  stop;  p|ff  -  Fj/D. 

3Pt  J,  2P(  ],  3PI  ] . Three-,  two-,  and  one-dimensional  fourier 

transformation,  Bq.  (30)  et  seq. . 

~3Pl  ],”2Pl  ],-1P[  ] . Inverse  three-,  two-,  and  one-dimensional 

fourier  transformation,  Eq.  (31)  et  seq.. 

g  »  G . An  arbitrary  space-time  function  and  its  fou¬ 

rier  transform  (spectrum). 

h(t)  «*  H(f) . Overall  impulse  response  and  transfer  func¬ 


tion  for  all  stages  of  linear,  shift-invar¬ 
iant,  analog  processing  of  detector  output 
including,  if  applicable,  temporal  averaging 
during  temporal-integral  sampling. 

i . Imaginary  unit,  i2  -  -1. 

kx,ky . Magnitudes  of  components  of  spatial  frequency 

vectors  k  -  kx  +  ky. 

Akx,Aky . Intervals  of  kx  and  ky. 

l,m,n . Integers  labeling  spatial  (l,m)  and  temporal 

(n)  sample  sites;  also  summation  indices  of 
sampling  functions,  Eqs.  (23a, b).  Spatial 
coordinates  of  sample  sites  are  (lAx,mAy), 
Fig.  3. 

L,M . Number  of  rows  (M)  and  columns  (L)  of  samples 


v 


in  cropped  images.  (L-1),(M-1)  are  maximum 
values  of  summation  indices  (l,m)  in  func¬ 


tions  representing  sampled  and  cropped  im¬ 
ages.  Fig.  4,  Eqs.  (28a, b)  and  (29a, b). 

°bX  *  Nbx . Background  near-normal  spectral  radiance. 

Fig.  1,  and  its  fourier  transform. 

PX  «►  . p\  is  the  monochromatic  point-spread  func¬ 

tion.  is  the  monochromatic  optical  trans¬ 
fer  function.  Both  are  for  a  geometric-opti¬ 


cal  projection  of  the  image  onto  the  object 
plane  and  are  expressed  in  object-plane  quan¬ 
tities. 


PX . Monochromatic  point-spread  function  in  the 

image  plane.  p\  is  expressed  in  image-plane 
quantities;  px  ■  Px/^* 

q  «*  Q . An  arbitrary  space-time  function  and  its  fou¬ 

rier  spectrum. 

rcm  and  rmr . Reciprocal  centimeter  and  reciprocal  milli- 

radian,  units  of  spatial  frequency. 

Rx . Peak  value  of  monochromatic  responsivity  on 

the  surface  of  a  detector  element. 

S . Surface  of  a  detector  element.  Fig.  2. 

s . Detector  or  sensor  output  before  measurement. 

The  unit  may  be  [amps,  carriers/sec,  volts, 
etc.]  depending  on  the  corresponding  unit  of 

Rx- 

&x  *  Sx . Spectral  output  of  a  detector  element  and 

fourier  transform  of  sx,  Eqs.  (19a,b)  and 
(43a, b). 

*Xf  *  sXf . The  pseudoimage  and  its  fourier  spectrum. 

&xf  is  analog-processed  spectral  output  of  a 


detector  element  whose  center  may  be  located 
anywhere  in  space.  Eqs.  (20a, b),  (21a, b), 
(46a,b),  and  (47a,b). 

<sxf> . The  pseudoimage  when  analog  processing  in¬ 

cludes  temporal  averaging  of  sx  during  tem¬ 
poral-integral  sampling. 

t . Time. 

at . Intraimage  sampling  period  (time  between  sam¬ 

ples)  for  an  image  from  a  scanning  sensor;  At 
■  Ax/C,  Fig.  3. 

T . The  epoch  of  an  image  (data  frame),  i.e., 

time  at  a  chosen  moment  during  image  acqui¬ 
sition. 


AT . 

UfaA  •  UbA . 

. 

r 

UA . 

u\  *  U\ . 

v . 

v\f  •  Vxf . 

\vXf\  *  vAf • • • • 

<vxf>A<vxf>\.. 

w  «W . 

(x,y),(x',y').. 

(xb^yb^^Xg'Yg) 

(Ax', Ay') . 

( *c , yc ) . 

Ax,  Ay . 

z  «  Z . 


.Tine  between  images,  i.e.,  interimage  (inter¬ 
frame)  sampling  period. 

.Apparent  background  spectral  irradiance 
and  its  fourier  transform,  Eqs.  (2a, b)  and 
(39a,b).  Both  include  atmospheric  properties 
0aX  an<^  optical  parameters  [0x*(A/d2]. 
.Spectral  irradiance  distribution  in  a  gauss- 
ian  image,  Eq.  (4). 

.Spectral  irradiance  distribution  in  the  actu¬ 
al  image.  Fig.  1,  Eqs.  (8)  and  (11). 

.ux  is  the  spectral  irradiance  distribution  in 
the  image  after  geometric-optical  projection 
onto  the  object  plane.  Fig.  1.  Ux  is  the 
fourier  transform  of  ux,  Eqs.  (13a,b)  and 
(40a,b). 

.Detector  or  sensor  output  after  measurement. 
The  unit  is  assumed  to  be  volts,  requiring 
the  corresponding  unit  of  Rx  to  be  volts. 

.An  instantaneously  sampled  pseudoimage  s^ 
and  its  fourier  transform,  Eqs.  (24a, b)  and 
(49a, b). 

.An  instantaneously  sampled  and  cropped  pseu¬ 
doimage  Sxf  and  its  fourier  transform,  Eqs. 
<28a,b)  and  (50a,b). 

.These  represent  v^  and  Ny^X  when  formation 
of  the  pseudoimage  &\f  includes  temporal 
averaging  during  temporal-integral  sampling. 
Eqs.  (26a, b), (29a, b). 

.An  arbitrary  space-time  function  and  its  fou¬ 
rier  spectrum. 

.Object-  and  image-plane  coordinates.  Fig.  1. 
.Coordinates  of  a  background  (object)  point 
and  its  ideal  geometric-optical  image  point. 
Fig.  1. 

Image-plane  coordinates  (x'-x^,y'-yg)  meas¬ 
ured  from  a  gauss i an  image  point,  Fig.  1. 
Central  coordinates  of  a  detector  element 
after  geometric  optical  projection  onto  the 
object  plane,  Figs.  2  and  1. 

Spatial  sampling  intervals,  Figs.  3  and  4. 

An  arbitrary  space- time  function  and  its 
fourier  spectrum. 


Greek  Letters 


(a,0) . Detector-center  coordinates  for  analog  pro¬ 

cessing  of  detector  output  s\,  i .e. ,  pseudo- 
image  (s^f)  coordinates  corresponding  to 
(xc,yc),  Eqs.  (20a,b)  and  (21a, b);  also  cen¬ 
tral  coordinates  of  all  possible  areas  for 
integration  of  image  ir radiance  by  the  detec¬ 
tor,  Pig.  3. 

r  *  r . Detector-response  function  and  detector 

transfer  function,  y  describes  the  photo¬ 
sensitive  surface  of  a  detector  element  (Fig. 
2)  and  any  variation  of  responsivity  on  that 
surface. 


c . Sampling  duration,  i.e.,  time  required  to 

measure  a  sample. 

t . Scan  rate. 

e^dx . Monochromatic  transmi ttances  of  atmosphere 

and  optics. 

X . Radiant  wavelength. 

n . Optical  magnification  -  x^/x^  ■  y^/Vb, 

Pig.  1. 

t . Time  at  which  output  from  analog  processing 

occurs,  Eqs.  (20a,b)  and  (21a,b). 

T\,Tx . Incoherent,  spectral,  radiant  flux  at  object 

and  image  planes,  Eqs.  (1),(6),(7). 


MULTIDIMENSIONAL  SYSTEM  ANALYSIS 
OF  ELECTRO-OPTIC  SENSORS  WITH  SAMPLED  DETERMINISTIC  OUTPUT 

I .  INTRODUCTION 

Much  effort  has  been  and  is  being  devoted  to  collection  of  optical 
background  data.  The  utility  of  these  data  would  be  increased  signifi¬ 
cantly  if  it  were  possible  to  calculate  from  them  the  values  that  would 
have  been  measured  in  the  same  circumstances  with  an  optical  sensor  of 
lower  spatial  resolution  and  sampling  rate.  There  have  been  intuitively 
based  attempts  to  do  this,  but  to  know  whether  or  to  what  extent  the  re¬ 
sults  are  valid,  the  computations  must  be  based  on  a  more  rigorous  and 
comprehensive  analysis  of  the  sensor  and  sampling. 

Such  an  analysis  is  presented  here.  Staring  sensors  and  one  type 
of  scanning  sensor  are  treated;  the  scanner  is  the  type  that  sweeps  the 
image  to  and  fro  over  the  detector.  System  equations  are  derived  initi¬ 
ally  in  the  space  and  time  domain  where  the  mathematics  are  easily  re¬ 
lated  to  physical  reality.  These  equations  then  are  fourier-transformed 
to  the  frequency  domain  to  complete  the  system  description.  None  of  the 
material  is  wholly  new.  This  is  a  review  article  whose  purpose  is  to 
collect  known  results  from  diverse  sources  and  provide  them  in  a  useful 
fora  in  one  place.  The  re stilts  can  be  used  not  only  for  synthesis  of 
background  data  as  mentioned,  but  also  for  equalization  (correction  of 
data  for  instrumental  effects),  and  for  engineering  of  electro-optic 
sensor  systems. 

II.  SPACE-  AND  TIME-DOMAIN  DERIVATIONS 

With  one  exception  the  treatment  will  follow  physical  and  exper¬ 
imental  order,  according  to  which  the  equations  fall  into  groups  de¬ 
scribing  image  formation,  detector  response,  analog  processing,  sampling 
of  sensor  output,  and  image  cropping.  Cropping  or  truncation  of  the 
image  is  formulated  last  for  mathematical  convenience,  although  physic¬ 
ally  it  occurs  during  image  formation  or  sampling.  Functions  represent¬ 
ing  the  analog  outputs  of  the  sensors  are  constructed  first.  Next  the 
types  of  sampling  permitted  by  sensor  motion,  spatial  integration  of  im¬ 
age  irradiance,  and  temporal  integration  of  sensor  output  are  described. 
Lastly  functions  representing  sensor  output  sampled  in  each  of  these 
ways  are  formulated.  The  relations  for  staring  sensors  depend  on  time 
and  two  spatial  coordinates,  and  the  results  describe  a  temporal  se¬ 
quence  of  sampled  images.  Scanning  links  time  and  the  spatial  coordi¬ 
nate  in  the  scan  direction.  Consequently,  the  relations  for  scanning 
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sensors  are  only  two  dimensional;  they  depend  either  on  two  spatial 
coordinates  or  on  time  and  the  cross-scan  spatial  coordinate.  Moreover, 
the  results  describe  only  one  sanqpled  image.  This  restriction  stems 
from  the  functions  used  to  represent  the  space-time  constraint  and  the 
sampling. 

The  functions  that  describe  the  optics  vary  only  with  the  spatial 
coordinates;  those  that  describe  analog  processing  vary  only  with  time; 
and  those  that  describe  sampling  vary  with  both  the  spatial  and  the  tem¬ 
poral  coordinates.  Thus  a  coordinate  can  be  a  variable  or  a  parameter 
at  different  stages  of  the  analysis.  The  two  types  of  dependence  are 
distinguished  by  placing  variables  on  the  left  of  a  semicolon  separating 
the  arguments  of  a  function,  e.g. ,  w(x,y,t),  w(x,y;t),  v(t;x,y).  All 
independent  coordinates  can  be  separately  varied  or  held  constant  at  any 
stage  of  the  analysis.  But  if  a  spatial  or  temporal  coordinate  that  has 
been  a  parameter  is  subsequently  varied,  or  vice  versa,  extra  manipula¬ 
tions  are  required  to  derive  the  corresponding  frequency-domain  rela¬ 
tions.  A  simpler  alternative  is  always  to  keep  the  full  complement  of 
variables  in  the  space-time  equations.  This  can  be  done  by  convolving 
the  equations  with  delta  functions.  The  technique  is  further  explained 
when  used.  It  can  always  be  assigned  physical  meaning. 

All  derivations  are  given  in  detail.  This  has  advantages  and  draw¬ 
backs.  The  chief  advantages  are  that  assumptions  and  approximations  are 
made  evident,  and  the  results  can  be  used  or  modified  easily  for  compu¬ 
tations  in  a  variety  of  circumstances.  On  the  debit  side,  the  details 
may  hide  the  main  results  and  the  outline  of  the  derivations.  To  combat 
this  tendency,  equations  expressing  the  main  results  are  marked  with  ar¬ 
row  prefixes  •»,  and  the  analog  output  equations  are  summarized  in  sub¬ 
section  II. D  using  a  concise  notation.  Anyone  who  wants  an  overview  of 
the  derivations  can  profitably  refer  to  this  subsection  at  any  time. 
Because  units  are  required  for  numerical  work,  typical  units  are  given 
for  most  quantities,  but  other  units  can  be  used  without  changing  the 
equations. 

A.  Image  I r radiance 

Figure  1  represents  an  optical  sensor  viewing  a  distant  source  of 
incoherent  radiation.  The  optics  may  have  one  element  or  several.  The 
figure  exhibits  the  coordinates  and  some  of  the  notation  as  follows: 

A  prime  designates  the  image  plane,  its  lack  the  object  or  background 
plane;  a  subscript  b  denotes  a  background  quantity,  its  absence  an  image 
quantity.  This  seemingly  redundant  notation  is  employed  for  expository 
purposes.  The  letters  n  and  u  stand  for  radiance  and  irradiance;  spec¬ 
tral  and  monochromatic  quantities  are  indicated  by  a  subscript  X  for 
wavelength.  The  distance  from  the  optical  aperture  to  the  background 
is  d;  Fl  is  the  equivalent  focal  length.  The  aperture  stop  of  area  A 
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may  or  aay  not  be  circular;  the  field  stop  is  a  photosensitive  detector 
in  the  image  plane.  Other  notation  will  be  introduced  and  defined  as 
needed. 


The  object  is  viewed  in  a  small  field  at  near-normal  incidence,  al¬ 
lowing  the  sensor's  subt  nse  to  be  equated  to  (A/d^),  and  the  direction¬ 
al  dependence  of  object  radiance  to  be  neglected.  The  object's  near¬ 
normal  spectral  radiance  is  n^xb'yb)  (watts/fcm^-steradian-micron)  ] , 
with  temporal  dependence  momentarily  disregarded.  The  combined  trans- 
mittances  of  atmosphere  and  optics  along  a  line  of  sight  are  @aXd\*  Un~ 
der  these  conditions  the  flux  in  wavelength  range  X  to  (X+dX)  collected 
by  the  optics  from  an  area  (dx^dy^)  at  object  point  (xb,yb)  and  imaged 
in  the  focal  plane  is  (ref.  1,  55. 5;  ref.  2,  55.6;  ref.  3,  511-5) 

d3Y^  -  9^0^*  [n^*  (dXfcdyb) ' (A/d2) *dxj  [watts] .  ( 1 ) 

In  order  for  detector  output  to  be  time  dependent,  nbx  in  Eq.  (1)  must 
depend  implicitly  or  explicitly  on  time.  Scanning  converts  spatial  de¬ 
pendence  of  radiance  to  temporal  dependence.  For  treatment  of  scanning 
sensors,  therefore,  object  radiance  can  be  assumed  time-independent  dur¬ 
ing  a  scan  and  denoted  by  nbx(xb'yb;T) '  T  sp®cifyin9  the  epoch  of 
the  scan  or  image.  With  a  staring  sensor,  object  radiance  must  be  an 
explicit  function  of  time  nbx(xb,Yb,t) • 


It  is  convenient  to  define  an  apparent  background  irradiance  u^, 
even  though  it  has  no  physical  significance. 


*  V  VVT)  or  ubx(xb'Vt) 


d3Y« 


[dXbdybdXj 


[watts/( cm  -micron) 


"  9aX* [0X(A/d2)] ’ [nbX(xb'yb;T)  or  nbX(xb'yb't)] •  (2a'b) 

This  simplifies  notation  and  allows  subsequent  equations  to  be  written 
more  concisely.  The  physically  significant  quantities,  however,  are  the 
optical  parameters  [0x(A/d^)],  the  atmospheric  properties  0ax,  and  the 
background  radiance  n^x-  Further  conciseness  is  achieved  by  omitting 
the  spatial  and/or  temporal  dependence  of  radiance  and  irradiance  when 
no  confusion  is  likely. 

The  points  (x^y^)  and  (Xg,yg)  in  Fig.  1  are  related  through  the 

optical  magnification  v,  a  negative  number  that  accounts  for  image  in¬ 
version  and  change  of  scale  between  the  object  and  image  planes.  If 
image  distortion  (curvature)  is  negligible, 

» -  -  vvb "  -FL/d>  (3) 


3 


-M 


These  equalities  follow  f  run.  the  ray  geometry  of  an  optical  system  with 
a  single  converging  thin  lens,  and  they  define  the  equivalent  focal 
length  of  a  compound  optical  system.  If  the  aperture  stop  is  circu¬ 
lar,  A  -  nD^/4,  and  the  equivalent  "F"  number  is  Ffff  -  Fj/D.  From 
these  relations  the  subtense  of  the  optics  at  the  background  is  (A/d^) 

-  (n/4)(///Fjff )2.  This  equality  can  be  used  to  replace  the  subtense  in 
Eq.  (2),  but  the  apparent  background  irradiance  still  depends  on 
background  range  through  //  and  0ax- 

If  the  optics  formed  a  gaussian  (ideal  geometric)  image,  d3Yx  would 
illuminate  an  image  area  (dx^dyg)  -  ^(dx^dy^) .  The  spectral  irradiance 
of  the  geometric  image  then  would  be 


9  .  9  •  » 

VW 


K^J 


9  Yw )  9 

- — -  [watts/( cm* micron) ] . 


In  fact,  flux  from  an  object  point  is  distributed  in  the  image  plane  as 
described  by  the  monochromatic  point-spread  function 

pX(xg'yg:x',y,)  “  pX(i“Vwb!X*'y,>  (5) 

The  point-spread  function  accounts  for  blurring  of  the  image  by  dif¬ 
fraction  and  aberrations;  other  sources  of  blurring  are  mentioned 
later.  The  fraction  of  d^?x  that  illuminates  an  image  area  (dx'dy' )  is 
PX*dx'dy' .  From  this  it  is  evident  that  px  has  units  of  reciprocal  area 
in  the  image  plane  and  is  normalized  so  that  //_£  px*d x'dy'  -  1.  The 
spectral  flux  received  by  (dx'dy')  from  (dx^dy^)  is,  therefore, 

d^Y^  -  d^Y^* (px*dx'dy' )  -  (u^^’dx^dy^dX) (p^- dx'dy ' )  (watts).  (6) 

Now  if  (xb,yjj)  is  moved  over  the  background,  (x^,yg)  moves  over  the  im¬ 
age,  and  flux  increments  from  all  object  points  can  be  suamed  to  give 
the  total  flux  at  (x',y')s 

dVx.  |J  ubX(xb,yb)-p^(^xb,^yb:x',y')-dxbdyb  -dx'dy'dA  (watts).  <7: 
The  bracketed  term  in  Eq.  (7)  is  the  actual  image  spectral  irradiance, 


f  .  f  r 

u.(x  ,y  )  - 


'  h3t»  • 

^  *  X  r  r  f  2 

— - — ■ —  -  JJ  Uh^'p^-dXhdYh  [watts/(cm  -micron) ) . 
dx  dy  dX  w 


Comparison  of  Eq.  (8)  with  the  geometric  image  irradiance  Eq.  (4)  shows 
that  the  actual  irradiance  contains  the  scale  factor  (l/i/2)  implicitly 
in  the  point-spread  function. 


Eq.  (8)  expresses  the  image  ir radiance  as  a  weighted  linear  super¬ 
position  of  the  apparent  background  ir  radiance  u^x*  But  the  weighting 
factor  px  changes  functional  form  with  shift  of  (x^,yg)  -  (/n c^,//^), 
and  so  Eq.  (8)  cannot  be  simplified  by  fourier  transformation  (ref.  4, 
pp.  40,108-110).  In  limited  regions  of  the  optical  field,  however,  px 
is  almost  a  shift  invariant  function  of  the  local  coordinates, 

Ax'  -  x'-Xg  -  x'-/^  and  Ay'  -  y'-y^  -  y'-Afyfa  [cm],  (9) 

that  is, 

p  (xg,yg:x  ,y  )  «  px(x  -V¥b)  [an  ].  (10) 

A  region  in  which  the  point-spread  function  is  adequately  approximated 
by  Eq.  (10)  is  known  as  an  isoplanatic  patch  (ref.  5;  ref.  6,  pp.  15-16, 
19).  In  an  isoplanatic  patch  the  image  spectral  ir radiance  is  given  by 

m 

u^(x',y')  -  JJ  Ubx'Px^  ^^^  -^b^’^^b  [watt*/( a®2* micron)  J .  (11) 

This  is  a  2-0  convolution  and  so  is  reduced  by  fourier  transformation 
to  a  simple  product  of  two  spectra.  Thus,  fourier  analysis  of  an  opti¬ 
cal  system  is  useful  only  in  an  isoplanatic  patch.  A  large  field  of 
view  may  have  to  be  divided  into  several  isoplanatic  patches  to  permit 
fourier  analysis  over  the  whole  field. 

The  image  can  be  blurred  by  atmospheric  turbulence,  aerosol  scat¬ 
tering,  and  sensor  motion  as  well  as  by  optical  aberration  and  diffrac¬ 
tion.  These  effects  can  be  accounted  for  at  least  approximately  by  in¬ 
cluding  in  the  integrand  of  Eq.  (11)  other  multiplicative  terms  like  px 
(ref.  7,  $13. 2;  refs.  8-13).  Such  terms  also  may  exhibit  isoplanatic 
effects;  that  is,  they  may  be  approximately  shift  invariant  only  in  lim¬ 
ited  regions  of  the  optical  field  (ref.  14).  For  simplicity,  factors 
representing  additional  blurring  of  the  image  are  omitted  here. 

Eq.  (11)  is  nevertheless  inconvenient  because  it  contains  both 
object-plane  and  image-plane  coordinates  which  differ  in  scale  and  ori¬ 
entation.  This  awkwardness  can  be  eliminated  by  projecting  the  image 
plane  onto  the  object  plane  under  ideal  conditions  -  gaussian  optics,  no 
atmospheric  absorption  or  turbulence,  no  sensor  motion,  etc..  The  pro¬ 
jection  is  indicated  in  Fig.  1  by  the  ray  from  (x',y')  to  (x,y).  In 
this  way  Eq.  (11)  becomes 


u^(x,y)  -  JJ  u^ •  p^( x-Xfo , y-y^ )  * cb^dy^  [watts/* on2 -micron)  ] , 


(12) 


with  Ujgx  given  by  Eq.  (2a  or  b).  Here  px  and  ux  are  the  point-spread 
function  and  image  ir radiance  expressed  in  object-plane  quantities;  px 
and  px  have  the  same  functional  form,  but  px  has  units  of  reciprocal 
area  in  the  object  plane  and  is  normalized  so  that  f  f  5  px*dxdy  -  1. 

Also  px  -  x^Px  s*nce  wust  px*dx'dy'.  Henceforth  all 

image-plane  quantities  are  to  be  converted  to  object-plane  quantities 
before  substitution  into  the  equations. 

TWo  variations  of  the  treatment  above  should  be  noted.  First,  Eq. 
(12)  can  be  derived  in  fewer  steps  simply  by  reversing  the  directions  of 
the  image-plane  axes  in  Fig.  1  and  equating  the  magnification  to  unity 
at  the  outset  (refs.  5,6).  Though  efficient,  this  befogs  the  physical 
meaning  of  the  mathematics  and  the  substitutions  needed  to  obtain  numer¬ 
ical  results  in  actual  cases.  The  derivation  given  here  deals  explicit¬ 
ly  with  these  issues  at  the  cost  of  lengthiness  and  a  more  elaborate  no¬ 
tation  than  is  essential.  Second,  some  authors  prefer  the  reverse  of 
the  projection  employed  here;  that  is,  they  project  the  object  plane 
ideally  onto  the  image  plane  and  use  Eqs.  (3)  and  (4)  to  write  Eq.  (11) 
in  terms  of  image-plane  quantities  (ref.  3,  SSll-5,11-6;  refs.  15,16). 
This  is  convenient  if  the  problem  being  solved  is  in  the  image  plane; 

Eq.  (12)  is  more  useful  if  the  problem  is  in  the  object  plane. 

It  is  now  necessary  to  examine  the  temporal  dependence  of  Eq.  (12) 
and  its  consequences  more  closely.  With  a  scanning  sensor,  u^x  “ 
ubx(xb>yb'’T) '  ant*  the  convolution  includes  all  variables.  When  the  time 
and  temporal-frequency  variables  are  introduced  later,  they  will  merely 
replace  x  and  the  conjugate  spatial-frequency  variable  kx.  Thus,  no 
awkwardness  will  develop  in  the  relations  of  either  the  space-time  or 
the  frequency  domain.  With  a  staring  sensor,  u^x  "  ubX<xb'Yb't) •  31x1 
the  convolution  includes  only  two  of  the  three  variables.  Time  could  be 
treated  as  a  parameter  and  later  regarded  as  a  variable  for  describing 
analog  processing,  but  this  would  make  both  the  space-time  and  the  fre¬ 
quency  relations  ungainly.  A  better  alternative  is  to  convolve  Eq.(12) 
with  a  temporal  delta  function  4(t*-t).  In  physical  terms  this  selects 
image  and  object  ir radiances  at  a  particular  time  t*.  But  t*  is  contin¬ 
uously  and  arbitrarily  assignable,  so  mathematically  time  remains  a  var¬ 
iable.  This  expedites  fourier  transformation  and  avoids  the  need  to  in¬ 
troduce  time  and  temporal  frequency  as  variables  later.  Thus,  conven¬ 
ient  image-ir radiance  functions  for  analysis  of  scanning  and  staring 
sensors  are 


*  ux(x,y,;T)  -  JJ  u^x^y^T)  •P^-V^b*  -dx^ 


-  9aX*  [9X<A/d2)]  ‘  JJ  nbx‘Px’<^xbc^b  (watts/<ai|2'Blicron)  ] ,  (13a) 
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ux(x,y,t#)  -  JJJ  ubX(xb,yb/t)-[px(x-xb,y-yb).6(t«-t)]-dxbdybdt 

m 

•  nbx*lpx*5] -dXhdy^t  (watts/(cm2*micron)  ] .  (13b) 


B.  Detector  Response 

Next  consider  the  arbitrarily-shaped  detector  in  Pig.  2  with  center 
at  (x,y)  -  (xc,yc)  and  monochromatic  responsivity  Rx»  constant  across 
the  detector  surface  S.  R\  will  be  expressed  in  (amps/Vmtt)  before 
measurement  of  response,  but  in  (volts/Vatt)  afterward,  because  detector 
current  usually  is  measured  by  the  voltage  it  produces  across  a  capaci¬ 
tor.  Image  irradiance  is  assumed  to  vary  slowly  relative  to  detector- 
response  time,  so  that  the  detector  always  responds  fully  to  the  illumi¬ 
nation.  The  output  from  flux  of  wavelengths  X  to  (X+dX)  is  then 


da  -  Rx*dX*JJ  ux*dxdy  [amps]. 


Bq.  (14)  could  be  integrated  over  wavelength  to  find  the  total  output, 
but  it  is  convenient  instead  to  define  spectral  output 


gj*  •  sx  -  RX-JJ  ux*dxdy  [aaps/micron] . 


Notation  is  now  simplified  by  postponing  the  integration  over  wavelength 
until  the  final  result  is  obtained. 

Bq.  (15),  though  correct,  does  not  transform  to  a  useful  frequency- 
domain  relation.  A  suitable  alternative  can  be  obtained,  however,  by 
inventing  a  detector-response  function  (Fig.  2)  such  that 

y(x  -x,y -y)  -  1  if  (x,y)  is  on  the  detector  surface, 
c  c 

■  0  elsewhere.  (16) 

With  this  function  Eq.  (15)  becomes  an  easily  transformable  convolution: 

m 

•x<Vyc>  -  Vfj  Uxu'yl  •r(xc~x,yc-y) *dxdy  [amps/micron] .  (17) 


,<* v  ■  .*  •  i 


For  the  rectangular  detector  of  width  a  and  height  b  in  Fig.  2, 
r  is  the  product  of  two  unit-amplitude  rectangle  functions  (ref.  4,  pp. 
52,243) : 

r-r.ct  (Street  |*=?) 

-  1  if  [xc-j]  <  x  <  [xc+|]  and  [yc-|]  <  y  <  [yc+|] , 

-  0  elsewhere.  (18) 

Response  functions  and  their  fourier  transforms  for  some  other  detector 
shapes  are  given  in  reference  17,  pp.  93-96.  More  generally,  if  the 
detector's  responsivity  varies  across  its  surface,  the  variation  can  be 
included  in  r;  the  tops  of  the  functions  in  Fig.  2  then  would  be  curved 
instead  of  flat.  Since  the  detector  is  the  field  stop,  it  acts  as  the 
type  of  spatial  filter  called  a  reticle.  Consequently,  response  func¬ 
tions  for  more  complicated  detector  shapes  and  responsivities  can  be  de¬ 
rived  by  reticle  design-methods  from  specifications  for  the  detector's 
spatial  frequency  response  (ref.  18,  pp.  485-502;  refs.  19-22). 

Eq.  (17)  with  u\  -  u^(x,y, ;T)  front  Eq.  (13b)  approximates  very 
nearly  the  momentary  output  of  a  detector  whose  field  of  view  is  swept 
over  the  background,  provided  the  detector  response-time  is  much  less 
than  the  dwell  time  of  an  image  point  on  the  detector.  Since  addition¬ 
ally  u\  is  assumed  constant  during  a  scan,  the  time  dependence  of  the 
output  is  easily  formulated.  With  a  constant  scan  rate  C  in  the  x  dir¬ 
ection,  xc  -  XQ+Ct  for  a  single  scan.  (For  repeated  scans  the  relation 
between  xc  and  t  is  a  sawtooth  wave,  and  \i\  is  not  independent  of  t; 
this  case  is  not  treated  here.)  Because  Eq.  (17)  is  shift  invariant, 
the  location  of  the  origin  is  immaterial  (ref.  3,  pp.  108-110),  allowing 
it  to  be  chosen  so  that  Xq  -  0.  The  scanning  detector  output  is  then 

m 

•*  sx(tt,yc)  -  Rx’JJ  ux(x,y;T)*y(Ct-x,yc-y)*dxdy  (amps/micron] .  (19a) 

Eq.  (17)  with  ux  »  ux<x,y,t#)  from  Eq.  (13a)  also  describes  the 
time-dependent  response  of  a  detector  whose  field  of  view  is  fixed  rel¬ 
ative  to  the  background.  But  the  convolution  of  Eq.  (17)  involves  only 
the  two  spatial  variables,  so  as  already  explained  an  additional  convo¬ 
lution  with  a  temporal  delta  function  is  needed  to  avoid  awkwardness  in 
the  equations.  This  gives  for  the  output  of  a  staring  detector 

*  sX(xc'yc't>  " 

m 

RX.JJ]  ux(x,y,t#)‘(r(xc-x,yc-y)'6(t-t°)]'dxdydt  [amps/micron] .  (19b) 


Eq.  (19a  or  b)  represents  the  deterministic  component  of  output 
from  a  detector  whose  center  is  located  arbitrarily  in  space.  The  out¬ 
put  also  contains  random  components  from  temporal  fluctuations  of  photon 
arrival  at  the  detector  and  free  charge  in  the  detector.  Only  the  de¬ 
terministic  component  is  considered  in  this  work. 

C.  Analog  Processing 

i 

' 

If  the  detector  output  is  sampled  directly  and  instantaneously, 

Eqs.  (19a  and  b)are  suitable  for  constructing  functions  to  represent 
sampled  images.  Before  sampling,  however,  the  output  may  pass  through 
one  or  more  stages  of  analog  processing.  As  discussed  later,  the  inte¬ 
gration  step  of  temporal-integral  sampling  usually  can  be  treated  as  the 
final  stage  of  such  processing.  Prior  to  that,  the  detector  output 
often  is  sent  through  an  analog  low-pass  or  band-pass  amplifier.  This 
serves  mainly  to  (1)  raise  the  output  well  above  any  interference  that 
might  be  picked  up,  (2)  limit  the  dynamic  range  of  the  output,  and  (3) 
reduce  aliasing  by  band  limiting  the  random  temporal  frequencies. 

It  will  be  assumed  that  each  stage  of  analog  processing,  including 
any  teiqporal  integration,  is  linear  and  shift  invariant.  Hie  overall 
effect  then  can  be  described  by  a  single  impulse  response  h(x),  which  is 
the  convolution  of  the  impulse  responses  of  the  stages.  The  processed 
detector  output  is  the  convolution  of  h(x)  with  Eq.  (19a  or  b).  Neither 
of  the  latter  convolutions  involves  the  spatial  variables.  Thus,  for 
reasons  already  explained,  it  is  convenient  to  perform  additional  convo¬ 
lutions  with  one  or  two  spatial  delta  functions.  The  processed  outputs 
of  scanning  and  staring  sensors  then  are  given  by 

*  »Xf(T'6>  -  II  V<t,yc)-[h<T-t).5(^yc)l-dtdYc  [fflgIf£ssa»].  ,20al 


and 

<♦  Sj^a^T)  - 

JJJ  sX^xc,^c't^  * l  S(*"xc>  ’*( 0-yc)  ’h(x-t)  J  •dxcc^cc*t’  (20b) 

The  convolutions  involving  h(x)  are  written  in  the  usual  way,  so  that 
x  is  the  continuous  time  at  which  the  output  occurs.  Likewise  a  and  0 
are  the  detector-center  coordinates  of  the  analog-processed  output  and 
are  continuous  variables.  If  there  is  no  analog  processing,  h(x-t)  - 
S(x-t).  The  temporal  convolution  of  Eq.  (20a)  has  a  curious  appearance 
because  the  argument  of  sx  is  not  t  but  position  of  the  detector  center 
Ct  -  xc.  Nevertheless,  the  integral  correctly  associates  values  of 
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s\(tt,yc)  with  tb  a*  of  h(x-t)  and  so  9ives  the  processed  output  cor¬ 
rectly.  The  su> script  f  on  the  output  symbols  indicates  filtering, 
which  is  appreciate  since  linear,  shift-invariant  processing  has  a  fil¬ 
tering  effect.  The  output  units  are  [(amps  or  volts )/toicron]  depending 
on  whether  Rx  in  Eqs.  (19a  and  b)  has  units  of  [ (amps  or  volts )/Vatt ] . 

D.  Synopsis  of  Analog-Response  Equations;  the  Pseudoimage 

The  equations  for  analog  output  have  been  derived  by  steps.  At 
tiach  step  a  function  symbolizing  a  physical  or  experimental  process  was 
convolved  with  a  function  embodying  the  result  of  all  prior  processes. 
Thus  the  derivations  can  be  summarized  concisely  by  writing  only  the  in¬ 
tegrands  and  using  the  character  *  to  indicate  the  integrations.  With 
this  notation  the  functions  symbolizing  the  analog  outputs  of  scanning 
and  staring  sensors  are,  respectively, 

*  s^T.efT)/^  -  ubX(xb'yb;T>  "  Px^-vy-V 

••  r(Ct-x,yc-y) 

••  Ch(r-t)-4(|5-yc)],  (21a) 

and 

*  8^10,0,1)^  -  ubX(xb'Vt)  ##*  tPx(x_Vy"yb)‘*{t*“t)I 

•••  [ r(xc-x,yc-y) • S( t-t° ) ] 

•••  l«(«»-xc)*4(5-yc)-h(T-t)].  (21b) 

(This  notation  differs  from  the  usual  one  which  esploys  asterisks  and 
omits  the  integration  variables,  e.g. ,  z(x)  ■  g(x)*v(x).  Here  the  ben¬ 
efits  of  displaying  the  integration  variables  outweigh  the  liabilities 
of  an  unfamiliar  notation.  Reference  23  discusses  deficiencies  of  the 
standard  notation  for  use  in  optical  analyses.) 

By  derivation  Eq.  (21a  or  b)  represents  analog-processed  output 
from  a  single  detector  with  center  located  arbitrarily  in  space.  But 
since  the  detector  center  can  be  anywhere,  Eq.  (21a  or  b)  gives  the  sen¬ 
sor  output  over  all  space.  Thus  s can  be  regarded  as  a  function  de¬ 
scribing  a  pseudoimage  -  the  actual  image  blurred  and  otherwise  altered 
by  the  detector  and  analog  processing  of  its  output.  This  interpreta¬ 
tion  is  probably  best  for  treating  sampling  and  understanding  the  f cou¬ 
rier  spectrum  of  the  sensor  output.  Typical  units  of  sxf  are  [volts/ 
micron]  when  detector  monochromatic  responsivity  Rx  is  expressed  in 
[volts/watt] .  The  factors  on  the  right  sides  of  Eqs.  (21a  and  b)  are 
the  apparent  background  spectral  irradiance  (ujjX),  the  monochromatic 
point-spread  function  of  the  optics  (p\),  the  detector-response  function 


(y),  and  the  overall  inpulse  response  (h)  for  all  stages  of  analog  pro¬ 
cessing  including,  if  applicable,  the  integration  step  of  temporal-inte¬ 
gral  sampling.  More  explicit  expressions  for  u^x  and  y  are  given  by 
Eqs.  (2),  (16),  and  (IS'.  Eqs.  (13a, b),  (19a, b)  and  (20a, b)  display  the 
integral  forms  of  the  convolutions  in  Eqs.  (21a,b). 

E.  Sampling 

For  clarity,  sampling  will  be  described  qualitatively  before  it  is 
treated  mathematically.  Spatial  sampling  of  an  image  can  be  implemented 
wholly  or  partly  by  arrays  of  photosensitive  elements.  As  suggested  by 
Fig.  3a,  the  elements  of  a  staring  array  frequently  are  square  and  lie 
side  by  side  in  rows  and  columns.  The  elements  of  a  scanning  array 
(Fig.  3b)  often  are  rectangular  and  are  stacked  in  columns  normal  to  the 
scan,  with  the  centers  of  elements  in  adjacent  columns  staggered  in  the 
cross-scan  direction.  The  cross- scan  fields  of  view  may  be  contiguous 
or  overlap  as  in  the  figure.  Each  element  may  have  its  own  amplifier, 
but  if  so  the  amplifiers  have  the  same  impulse  response,  so  that  the 
output  in  any  channel  is  given  by  Eq.  (21a  or  b). 

Eqs.  (15)  and  (17)  show  that  the  analog  outputs  result  from  spatial 
integration  of  image  ir radiance  by  the  finite-size  detector  elements. 
Depending  on  the  type  of  sensor,  this  represents  partial  or  complete 
spatial  integral-sampling  of  the  image,  which  results  in  aliasing  of 
image  spatial-frequencies  unless  they  are  properly  band  limited  (refs. 
24,25;  ref.  26,  sec.  6.3.2;  ref.  27,  ch.9).  With  a  staring  sensor  both 
the  row  (y)  and  column  (x)  spatial-frequency  components  can  be  aliased 
in  the  analog  output  because  the  detector  geometry  and  mode  of  operation 
spatially  sample  the  image  in  both  directions.  Consequently,  with  a 
staring  sensor,  spatial  band-limiting  can  be  achieved  only  by  optical 
means  (control  of  blur-circle  and  detector  sizes).  On  the  other  hand,  a 
scanning  sensor  spatially  samples  the  image  in  the  cross-scan  (y)  but 
not  in  the  scan  (x)  direction.  Thus,  the  cross-scan  spatial-frequency 
components  ky  can  be  aliased  in  the  analog  output,  but  the  co-scan  com¬ 
ponents  kx  cannot  be.  In  addition,  scanning  converts  the  x  components 
to  temporal  frequencies  which,  assuming  no  lag  in  detector  response,  are 
given  by  f  -  Ckx.  It  follows  that  the  cross-scan  spatial  frequency  com¬ 
ponents  can  be  band  limited  only  by  optical  man*,  but  the  co-scan  com¬ 
ponents  also  can  be  band  limited  by  sending  the  detector  output  through 
an  analog  amplifier.  Ordinarily,  however,  filtering  by  the  detector 
size  attenuates  the  spatial  frequencies  far  more. 

An  optical  sensor's  analog  output  usually  is  further  sampled  in 
time.  This  always  involves  charging  a  capacitor  and,  thus,  temporal 
integration  of  charge,  but  the  sampling  is  effectively  instantaneous  if 
the  output  and  the  sensor's  field-of-view  change  little  during  sample 
measurement.  In  any  case,  the  resulting  samples  may  be  assigned  to 


points  of  space  and  moments  of  time  at  the  centers  of  the  spatial  and 
temporal  integration  intervals.  Together,  spatial  and  temporal  sampling 
impose  on  the  image  a  pattern  of  ir radiance-integration  areas  and  sample 
sites  at  intervals  of  (Ax, Ay)  as  shown  in  Fig.  3.  The  sample  sites  are 
labeled  by  integers  (l,m)  so  that  their  coordinates  are  (lAx,mAy).  with 
a  staring  sensor,  spatial  and  temporal  sampling  are  independent.  The 
integration  areas  are  always  identical  to  the  detector-element  areas  and 
so  cannot  overlap  (Fig.  3a).  With  a  scanning  sensor,  spatial  and  tempo¬ 
ral  sampling  are  linked  through  scan  rate  £,  sampling  duration  e,  and 
sampling  period  At  >  e.  Temporal  sampling  induces  spatial  integral-sam¬ 
pling  of  the  image  in  the  scan  direction  and  results  in  aliasing  of  the 
co-scan  spatial-frequency  components  kx  unless  they  have  been  band  lim¬ 
ited  either  optically  or  electronically.  The  integration  areas  exceed 
the  detector-element  area  unless  the  detector  moves  little  during  sample 
measurement  (Ct  «  a).  The  integration  areas  can  overlap,  adjoin,  or  be 
separated  in  the  scan  direction  depending  on  whether  (a+te)  >,  -,  <  CAt. 
Fig.  3b  shows  a  case  in  which  (a+tc)  >  CAt  and  e  <  At,  so  that  the  co¬ 
scan  overlap  [a+C(e-At)]  is  <  a.  Zt  should  be  noted  that  in  Fig.  3b  the 
offsets  between  the  responses  of  detector  elements  in  different  columns 
have  been  removed  to  align  the  sample  sites  in  the  cross-scan  direction. 
This  can  be  done  in  one  of  three  ways:  by  electronic  delay  before  sam¬ 
pling;  by  making  the  ratio  of  column  interval  to  sampling  interval  an 
integer  and  then  shifting  samples  in  different  rows  by  the  corresponding 
number  of  sites;  or  by  interpolation  of  the  sampled  outputs.  The  second 
method  is  much  the  simplest  in  both  practice  and  theory;  the  first  is 
cumbersome  to  implement,  and  the  third  is  equivalent  to  reconstructing 
the  output. 

(The  type  of  sensor  and  sampling  used  in  a  particular  case  depend 
on  the  spatial  and  temporal  coverage  needed  and  certain  engineering  con¬ 
siderations.  If  the  background  or  signal  radiance  changes  during  the 
scan  time,  a  staring  sensor  must  be  used  when  temporal  information  is 
important,  even  though  spatial  information  is  lost  between  the  integra¬ 
tion  areas.  On  the  other  hand,  if  the  background  and  signal  radiance 
are  constant  during  the  scan  time,  a  scanning  sensor  is  preferable  since 
it  allows  complete  spatial  coverage  and  smaller  spatial  sampling  inter¬ 
vals  in  both  the  scan  and  cross-scan  directions.  In  practice,  temporal 
integral-sampling  usually  is  eeployed  for  surveillance,  instantaneous 
sampling  for  data  ollection.  Charge  from  the  detector  of  a  surveil¬ 
lance  sensor  customarily  is  stored  during  successive  time  intervals  of 
fixed  duration,  and  the  resulting  sequence  of  charge  packets  is  read  out 
through  a  single  lead.  This  procedure  is  followed  because  the  detector 
commonly  has  too  many  photosensitive  elements  to  permit  a  lead  for  each 
one.  The  detector  of  a  data-collection  sensor  ordinarily  has  fewer  ele¬ 
ments,  and  temporal  integration  of  the  output  is  undesirable  because  it 
adds  another  instrumental  effect  to  the  data.) 


The  stage  is  now  set  for  derivation  of  the  2-D  sampling  equations 
except  for  one  item:  Attention  is  directed  to  a  lucid  graphical  and  al¬ 
gebraic  treatment  of  temporal  sampling  in  chapters  5  and  6  of  reference 
28,  and  to  a  brief  overview  of  2-0  spatial  sampling  in  section  6.3.1  of 
reference  26.  Anyone  who  has  trouble  following  the  derivations  below 
should  first  study  these  sources. 

Sampling  of  a  temporal  wave from  is  most  often  treated  as  amplitude 
modulation  of  a  pulse-train  carrier  by  the  waveform;  that  is,  the  pro¬ 
cess  is  represented  mathematically  h'  a  product  of  carrier  and  waveform 
functions.  The  carrier  pulses  usually  are  identical,  equally  spaced, 
and  rectangular.  Other  kinds  of  sampling  are  possible,  but  this  is  the 
most  common  type.  Sampling  ordinarily  is  followed  by  holding,  quanti¬ 
zation,  and  encoding  of  the  sample  values.  (Ref.  29,  SS2.4,2.6)  The 
present  treatment  is  limited  to  the  most  common  type  of  sampling  with  no 
consideration  of  the  last  three  steps. 

For  "instantaneous”  sampling  the  pulse  width  (sampling  duration  e) 
is  less  than  both  the  time  between  pulses  (sampling  period  At)  and  the 
least  time  constant  of  the  waveform.  The  carrier  then  can  be  approxi¬ 
mated  mathematically  by  a  comb  distribution  (ref.  29,  pp.  52-59;  ref.  3, 
$3.2): 

-  3  "«««*>  [sec-1]  (22) 


To  sample  the  multiple  outputs  of  an  electro-optical  sensor,  there  must 
be  a  pulse  train  at  the  position  of  each  output.  With  a  scanning  sensor 
this  requires  a  pulse  train  at  the  cross-scan  position  of  each  detector 
element.  The  carrier  function  for  instantaneous  sampling  during  a  sin¬ 
gle  scan  can  be  written  as  the  product  of  a  temporal  and  a  cross-scan 
spatial  comb  (ref.  3,  $3.4): 

. jVut, ( (cm  •sec)-1].  (23a) 

The  time  variable  is  represented  by  t  to  agree  vj.th  Eq.  (21a).  In  Eq. 
(22)  "n"  is  the  temporal  summation  index;  in  Eq.  (23a)  "1”  is  used  in¬ 
stead  to  indicate  the  equivalence  of  time  and  position  in  the  scan  (x) 
direction.  Eq  (23a)  tacitly  represents  a  2-D  spatial  array  of  impulses 
that  are  deployed  column-by-column  at  intervals  of  Ax  -  CAt  during  a 
scan.  Because  the  time  AT  between  images  must  be  at  least  as  great  as 
the  scan  time,  it  is  necessary  that  AT  >  (1-1) At,  where  1  is  the  number 
of  columns  in  the  impulse  array.  Thus  Eq.  (23a)  is  limited  to  one  scan; 
it  cannot  be  used  in  representing  a  sequence  of  images  from  successive 
scans,  a  problem  not  treated  here. 


The  carrier  function  for  instantaneous  sampling  of  a  staring  sen¬ 
sor's  output  is  effectively  a  temporal  sequence  of  impulse  arrays.  It 
can  be  written  as  the  product  of  a  temporal  comb  with  two  spatial  combs: 


combU/Ax),^^7)  combU/AT)  [ (cn^-sec)"1] 


•  •  • 

-  I  S(  oe-lAx)  •  l  5<0-mAy)*  l  $ ( T-nAT ) .  (23b) 


AT  is  both  the  sampling  period  and  the  time  between  sampled  images  (also 
called  data  frames),  so  that  the  epoch  of  an  image  is  T  -  nAT. 


An  instantaneously  sampled  image  from  a  scanning  sensor  is  now  rep¬ 
resented  by  the  product  of  Eq.  (21a)  for  the  analog  output  and  Eq.  (23a) 
for  the  sampling  carrier: 

■*  (dv/dA)j  ■  v^(t,0;T)  [ volts/( micron* cm* sec ) ] 

-  •X£(t,(5;T)*  ^  S(x-lAt)*  J  AO-mAy) 

-^5  2  sX£(lAt,mAy;T)*[s(T-lAt)*AO-mAy)J.  (24a) 

The  grave  accents  '  denote  sampled  quantities;  the  last  equality  follows 
from  the  relation  g(x)*A(x-a)  -  g(a)*S(x-a);  and  the  voltage  unit  indi¬ 
cates  units  of  (volts/Watt)  for  R\  in  Eq.  (21a).  With  a  staring  sensor 
Eq.  (21b)  represents  the  analog  output  and  Eq.  (23b)  the  carrier,  so 
that  the  instantaneously  sampled  image  is  symbolized  by 


(dv/dX) ^  ■  v^(a,0,x)  (volts/(micron*cm2*sec)  ] 

*Xf 

•  322  Sj^(lAx,mAy,nAT)*  £s(*-lAx)*S(0-mAy)*A(T-nAT)j 
!,*»**■  • 


m  m  m 

-  Sw(a,0,T)*  l  4(  a-lAx)  •  J  S ( 0-fflAy )  •  %  S(T-nAT) 


(24b) 


Zt  should  be  noted  that  v^£(t,0;T)  and  v\f(a,0,r)  are  distributions 
(generalized  functions);  they  are  not  arrays  of  sample  values,  which  are 
obtained  by  integration  of  Eqs.  (24a  and  b).  For  example,  the  (l,m,n)th 
sample  value  is  obtained  from  Eq.  (24b)  by  integration  between  the  lim¬ 
its  [(l±c)Ax,(m±c)Ay, (n+c)At]  with  0  <  c  <  1. 


As  already  mentioned,  sampling  in  operational  sensors  usually  is 
not  instantaneous.  Rather,  the  sampling  duration  is  a  significant  frac¬ 
tion  of  the  sampling  interval  and  the  least  time  constant  of  the  wave¬ 
form  being  sampled.  This  is  called  finite-pulse-width  or  temporal-inte¬ 
gral  sampling.  The  reason  for  the  latter  name  will  soon  appear,  a  rig¬ 
orous  treatment  of  temporal-integral  sampling  is  not  simple,  and  the  re¬ 
sults  are  circuit-dependent  (ref.  29,  $2.7;  ref.  30,  ch.  9;  ref.  31,  ch. 


11;  refs.  32-37).  However,  the  following  heuristic  treatment  is  valid 
for  the  most  commonly  used  circuits.  After  modulation  the  tops  of  the 
carrier  pulses  ideally  have  the  shape  of  the  modulating  waveform  in  the 
sampling  durations.  (Hence  the  modulation  process  also  is  called  wave¬ 
form  chopping.)  To  obtain  measures  of  the  waveform  amplitude,  the  modu¬ 
lated  pulse  heights  must  be  averaged  over  the  pulse  width.  This  can  be 
done  by  convolving  the  pulses  with  a  unit-area  rectangle  function  having 
width  e  and,  for  causality,  center  (e/2): 

^rect[T~<^]  -  1  if  0  <  t  <  e, 

a  0  elsewhere.  (25) 

But  the  same  result  must  be  obtained  if  first  the  sensor  output  is  con¬ 
volved  with  the  rectangle  function,  and  then  the  time-averaged  waveform 
is  sampled  instantaneously  at  times  corresponding  to  the  trailing  pulse 
edges.  Thus  the  most  common  integral  samplers  are  equivalent  to  a  lin¬ 
ear  filter  (integrator)  followed  by  an  instantaneous  sampler  (ref.  29, 
p.  42;  ref.  3,  pp.  283-285;  refs.  36-37). 


For  simplicity,  temporal  integration  of  sensor  output  is  included 
in  the  overall  impulse  response  for  analog  processing.  In  other  words, 
Eqs.  (21a  and  b)  represent  temporally  averaged  or  unaveraged  waveforms 
depending  on  whether  h( t)  includes  the  equivalent  impulse  response  of  a 
temporal-integral  sampler.  Consequently,  Eqs.  (24a  and  b)  are  easily 
modified  to  represent  integrally  sampled  images;  with  temporal  averaging 
indicated  by  angular  brackets  <  >,  the  relations  for  scanning  and  star¬ 
ing  sensors  are 
* 

<v^f(x,0;T)>  (volts/(micron*cm*sec) ] 


m  m 
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(26a) 


and 
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5(f3-mAy)*  J 
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"222  <s^(lAx,mAy,nAT)>'  ^S(oe-lAx)  •&(0-mAy)  •&(x-n&T)j  .  (26b) 
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Use  of  a  rectangle  function  for  waveform  averaging  assumes  that  the 
sampling  circuit  forms  an  unweighted  average  of  the  pulse  height.  If 


not,  the  rectangle  function  is  simply  replaced  by  the  correct  weighting 
function,  which  is  the  equivalent-circuit  impulse  response  normalized  to 
have  unit  area.  This  is  similar  to  inclusion  of  nonuniform  detector  re- 
sponsivity  in  the  detector-response  function  Eq.  (16).  With  a  scanning 
sensor,  temporal  averaging  of  pulse  height  results  in  the  irradiance- 
integration  areas  of  Fig  3b.  This  is  physically  obvious  and  follows 
from  Eq.  (21a)  and  the  commutative  property  of  convolution.  Thus  the 
treatments  of  spatial-integral  and  temporal-integral  sampling  are  anal¬ 
ogous  and  consistent. 

Fig.  3  and  the  discussion  above  indicate  that  scanning  and  temporal 
integration  effectively  reduce  spatial  resolution  and  detector  respon- 
sivity.  Resolution  is  reduced  because  the  integration  area  exceeds  the 
detector-element  area.  Responsivity  is  decreased  because  at  any  time 
the  detector  element  occupies  only  a  fraction  of  the  integration  area, 
whereas  it  always  would  occupy  the  whole  area  if  the  sensor  were  star¬ 
ing. 


Finally,  it  should  be  noted  that  neither  instantaneous  nor  integral 
sampling  is  shift  invariant.  The  waveform-averaging  step  of  integral 
sampling  is,  but  the  instantaneous-sampling  step  is  not.  The  sample 
values  depend  on  the  phase  between  the  comb  function  and  the  waveform 
being  sampled.  This  is  important  at  low  sampling  rates. 

F.  Image  Cropping 

TO  obtain  finite  arrays  of  samples  for  recording,  the  images  and 
image  sequences  must  be  truncated.  This  is  done  physically  by  trunca¬ 
ting  the  carrier  before  modulation  (ref.  3,  p.  278),  but  the  order  of 
the  operations  is  mathematically  reversible  because  the  result  is  ex¬ 
pressed  by  an  associative  and  commutative  product  of  functions. 

The  cropping  or  truncating  function  for  one  image  from  a  scanner  is 
a  product  of  two  unit-amplitude  rectangle  functions  that  select  M  rows 
of  the  image  and  L  samples  in  each  row.  For  computation  it  is  desirable 
to  have  the  summation  indices  of  the  cropped  image  function  begin  with 
zero.  This  is  accomplished  as  shown  in  Fig.  4  by  placing  the  lower  edge 
of  each  rectangle  function  one-half  sampling  period  below  the  coordinate 
origin.  The  cropping  or  truncating  function  now  can  be  written 

crop(x,At,L:0,  Ay,M)  -  rect  [T~ ( ) ]  •  rect  [P~ ( ] ] 

- 1  if  (=r)  < T  <  H)at  (=§*)  < *  <  HK* 


0 


elsewhere. 


(27a) 


Eq.  (27a)  is  easily  extended  to  obtain  a  function  that  acts  on  the  sam¬ 
pled  output  of  a  staring  sensor  to  select  and  crop  the  image  with  epoch 
T  -  0.  Recalling  that  r  and  x  are  equivalent  in  Eq.  (27a)  and  that  T  - 
nAT,  one  sees  that  the  desired  function  is 

crop(a,Ax,L:0,Ay,M:x,AT) 

-  r.ct . rKt . recU T/AT] 

" 1  if  fr1)  <  a  K  <  6  <  (*4)^ 

and  ( -AT/2 )  <  t  <  (AT/2); 

-  0  elsewhere.  (27b) 


Cropped  images  are  represented  by  the  products  of  Eqs.  (27a,b)  with 
Bqs.  (24a, b)  and  (26a, b).  Thus,  with  \  \  denoting  truncation,  instan¬ 
taneously  sampled  and  cropped  images  with  epoch  T  -  0  are,  for  a  scan¬ 
ning  sensor, 

+  \v^(t,(J;TW))\  (volts/(micron*cm*sec) ] 

(L-1)(M-1) 

-  2  I  sw(lAt,mAy;T-0)  •  ( 5( x-lAt)  •  $( (J-mAy)  J ,  (28a) 

1-0  m-0  ** 

and  for  a  staring  sensor, 

t)\  ( volts/(  micron* cm^* sec ) ] 

-  •r.cttx/.T) 
(L-1)(M-1) 

■  2  I  sv-(lAx,mAy;^0)*t6(oe-lAx'*8(3-mAy)*6(T)  ] .  (28b) 
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The  corresponding  integrally  sampled  and  cropped  images  from  scanning 
and  staring  sensors  are 

\<vXf(T,0;T-O)>\  (volts/( micron* cm* sec) ) 

(L-1)(M-1) 

"I  I  <s.  f  (lAt,mAy;T»0)>  •  ( 5(r-lAt)  *5(  (3-mAy)  ] ,  (29a) 

1-0  m-0 


and 
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III.  FREQUENCY-DOMAIN  DERIVATIONS 

Frequency-domain  equations  are  obtained  simply  by  taking  fourier 
transforms  of  space-  and  time-domain  equations.  For  this  purpose,  cer¬ 
tain  definitions  and  mathematical  relations  are  needed. 

The  fourier  transform  has  been  defined  in  at  least  six  ways  dif¬ 
fering  in  normalization  constant  and  sign  of  exponent.  In  addition, 
both  members  of  a  transform  pair  have  been  called  the  inverse  by  dif¬ 
ferent  authors.  The  conventions  and  notation  used  nere  are,  for  the 
transform. 


G(kx,ky,f )  ■  3F[g(x,y,t)]  ■  JJJ  g*exp[-i2ji(kxx+kyy+ft) J *dxdydt,  (30) 


and  for  its  inverse, 

«• 

~3F[G(kx,ky,f) ]  ■  JJJ  G*exp[i2’»(kxx+kyy+ft)]‘dkxdkydf  -  g(x,y,t).  (31) 


A  space-time  function  and  its  transform  are  denoted,  respectively,  by 
the  small  and  capital  forms  of  a  letter.  The  operator  symbols  3F[  ]  and 
“3F(  ]  are  explained  by  the  integrals.  In  these  relations  i  »  /(-l); 
(x,y,t)  and  (kx,ky,f)  are  sets  of  independent,  orthogonal  coordinates 
consisting  of  pairs  of  conju  ;  es  (x,kx),  (y,ky),  (t,f);  f  is  temporal 
frequency;  and  (kx,ky)  are  the  magnitudes  of  the  components  of  the  spa¬ 
tial  frequency  vector  k  -  kx+ky.  The  unit  of  f  adopted  is  the  (cycle/ 
sec)  or  hertz  (hz).  Common  units  of  k  are  the  (cycle/cm)  and  (cycle/ 
mr),  which  also  are  called  the  reciprocal  centimeter  (rcm)  and  recipro¬ 
cal  milli radian  (rmr).  The  former  is  used  here.  Spatial  frequencies  in 
the  object  and  image  planes  are  related  by  k  -  /jk' ,  but  this  relation  is 
not  needed  here  since  all  quantities  are  measured  in  the  object  plane. 

With  a  staring  sensor  there  are  no  constraints  among  the  coordi¬ 
nates.  All  are  independent  and  can  be  treated  as  variables  or  para¬ 
meters.  Eqs.  (30)  and  (31)  then  allow  three-,  two-,  and  one-dimensional 
transforms.  Examples  of  the  latter  types  are 

2F[g(x,y;t)]  -G(kx,ky;t),  1F[g(t;x,y)]  -G(f;x,y), 
~2F(G(kx,ky,-f )  ]  -  g(x,y;f ) ,  _1F[G( f ;kx,ky)  -g(t;kx,ky). 
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Scanning  introduces  the  constraints  xc  -  £t  and  f  -  tkx,  which  rule 
out  3-0  transforms.  The  choices  of  independent,  conjugate  coordinates 
are  (y,ky)  and  either  (x,kx)  or  (t,f).  Eqs.  (30)  and  (31)  give  differ¬ 
ent  2-D  transform  pairs  depending  on  the  choice.  Consequently,  the 
scaling  relations  between  the  results  in  the  two  cases  are  required. 
These  are  well  known  but  are  displayed  below  for  ease  of  reference. 


2F{g(x,y)]  ■  JJ  g-exp[-i2ji(kxx+kyy)]*dxdy  •  G(kx,ky)  -  G(f/C,ky)  (32) 


2F[g(Ct,y)]  ■  JJ  g*exp[-i2n(ft+kyy))*dtdy  -  ~-G(kx,ky) 


-  ±-G(f/t,ky) 


^F(G(kx,ky)  ]  ■  JJ  G‘exp[i2ji(kxx+kyy)]*dkxdky  «  g(x,y) 


ZF[G(f/C,ky)]  m  JJ  G*exp( i2n( ft+kyy )  ]  *dfdky  -  t*g(x,y) 


C*g(Ct,y) 


TV»o  versions  of  the  convolution  theorem  are  needed.  They  are  de¬ 
rived  in  references  3  (p.  196)  and  38  (p.  57)  for  one  variable;  deriva¬ 
tions  for  two  and  three  variables  are  easily  developed  from  these  ex¬ 
amples,  as  in  appendices  A  and  B.  One  version  of  the  theorem  says  that 
the  transform  of  a  convolution  is  the  product  of  the  transforms  of  the 
convolved  functions.  Because  a  variety  of  functions  have  been  convolved 
in  Part  II,  this  version  is  needed  in  all  the  guises  below.  For  the 
scanning  cases  it  is  also  desirable  to  express  the  different  forms  in 
terms  of  the  two  equivalent  frequencies  kx  and  f. 

2F[g(x° ,y° )°°w(  x— x° ,y-y° ) ] 

-  G(kx,ky)-W(kx,ky)  -  G(f/C,ky)*W(f/t,ky)  (36a) 

2F[g(x,y)°*w(  Ct-x,y°-y)  ] 

-  G(kx,ky).^»(kx,ky)  -  G(f/C,ky)-iw(f/C,ky)  (36a') 

2F{g( Ct,y° )««(q( t°-t) .w(y-y° ) ] } 


(36a') 


^G(kx,ky) *Q{ Ckx) *W(ky)  -  iG(f/C,ky)-Q(f)-W(ky)  (36a") 


3F{g(x,y,t)®«®{q(x°-x,y0-y)«w(t°-t) ]}  -  G(kx,ky,f ) *Q(kx,ky) -W(f )  (36b) 

3F{g(x°,y0,t)®°®[q(x-x0) *w(y-y°) -z(t°-t) ]} 


-  G(kx,ky,f)-Q(kx)-W(ky)-Z(f)  (36b') 


'TO  i  * 


'WIv'V* 


A  second  version  of  the  theorem  says  that  the  transform  of  a  product  is 
the  convolution  of  the  transforms  of  the  factors.  Symbolically, 

3F{g(x,y,t)*(q(x)*w(y)*z(t) ]} 

-  G(k«,k*,f)*Q(kx-k*)*W(ky-k*)*2(f-f)  (37) 

Eq.  (37)  suffices  with  this  version  because  it  is  never  necessary  to 
transform  products  with  factors  different  from  those  shown,  and  because 
the  2-0  equation  is  obtained  by  omitting  x  components  from  Eq.  {21). 

The  transform  definitions  and  convolution  theorems  are  expressed  in 
terms  of  the  general  space-time  coordinates  (x,y,t).  In  applying  these 
relations  one  must  recall  distinctions  already  made  between  (x,y,t)  and 
other  associated  coordinates.  For  example,  (xc,yc)  are  the  spatial  co¬ 
ordinates  of  the  detector  center,  and  (a,fi)  are  the  central  coordinates 
of  the  spa  tied  integration  intervals.  Also  the  space- time  scanning  con¬ 
straint  is  xc  •  Ct,  not  x  -  Ct.  But  there  are  no  such  distinctions  be¬ 
tween  the  frequency  coordinates;  (kx,ky,f)  are  conjugate  to  any  of  the 
respective  space-time  coordinates,  and  the  scanning  constraint  for  fre¬ 
quencies  is  f  -  (kx  regardless  of  the  space-time  coordinates. 

Frequency-domain  equations  are  now  derived  by  straightforward  but 
tedious  application  of  the  transform  definitions  and  convolution  theo¬ 
rems  to  the  space-  and  time  domain  results.  Subsection  XID  summarizes 
the  analog  frequency-domain  equations  and  provides  an  overview  which 
cuts  through  the  details  of  their  derivation. 

A.  Fourier  Spectra  of  Object  and  Tange 

From  Bq.  (30)  the  fourier  spectra  of  the  object  radiance  for  treat¬ 
ment  of  scanning  and  staring  sensors  are 

Nbk(,tx'ky'*T>  "  2ptnbA<*b»yb^T)l  lwatts/( cm2 *str •micron* rem2)  I  (38a) 
and 

Nbx<kx,ky,f)  ■  3F[n*,x<*b»yb't)]  ['•tts/(cm2*str*micron*rcm2*h*) J .  (38b) 

Transformation  of  Eqs.  (2a  and  b)  according  to  Bqs.  (32)  and  (30)  gives 
the  spectra  of  the  apparent  object  ir radiances  in  the  two  cases: 

0bX<kx'ky'“r)  *  2Hubx<xb'yb'’T)  1  [watts/( cm2 •micron*  rem2)  ] 

-  9aX’  [®X<A/d2)]  •Nbx(kx,ky;T)  -  9aX*  [®X<Vd2)]  -r^x(  f/C,ky;T) ;  (39a) 

Ubx<*x.ky,f)  ■  3*l«hX<*b'Yb»t,l 

-  9aX’  [sx^Vd2) j  *Nbx(kx,ky,f )  [watts/fcm^sucronTca^-hz) ) .  (39b) 
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Fourier  spectra  of  the  image  ir radiances  are  obtained  by  transform¬ 
ation  of  Eqs.  (13a  and  b)  using  Eq.  (30)  and  the  convolution  theorems  of 
Eqs.  (36a  and  b): 

U\(kx,ky;T)  ■  2F(ux(x,y;T) ]  [watts/fcm^micronTcm2)  ] 

-  2Pt^x<xb'Yb',T>*^X<x-xb'y-yb>] 

-  UbX(kX/ky?T)-Px(kx,lcy)  -  UbX(fA,ky;T)*Px(f/C,ky)  (40a) 
Ux(kx»ky,f)  ■  3F[Ux(x,y,t) ] 

•  3p,(ubX<xb»yb*t)##*(pX(x-xb,y-yb)*5(t0-t)]} 

■  ^bX^x'ky'^) *Px(kx'ky)  ( watts/(  an2  "micron*  ran2  •  hz )  ]  (40b) 

Since  ux  is  image  irradiance  projected  ideally  onto  the  object  plane, 
all  quantities  in  Eqs.  (40a  and  b)  are  to  be  measured  in  the  object 
plane. 

The  factor  Px  in  these  equations  is  the  fourier  transform  of  the 
point-spread  function: 

Px(fcX/Ky)  ■  2Flpx(x-Xb,y-yb)l  [dimensionless]  (41) 

If  px  is  approximated  by  a  circular  gaussian  function, 

Px^x'fcy)  *  2F(c~2-exp(-K(x-jq5)2/c2]*exp[-«(y-yb>2/c2]} 

■  expl-ac^kjj+k^)].  (42) 

Eqs.  (42)  and  (40a,b)  indicate  that  the  optics  filter  the  object  spec¬ 
trum,  as  follows.  Hie  parameter  c,  which  is  a  measure  of  the  blur  cir¬ 
cle  size,  governs  the  variation  of  the  gaussian  functions.  If  the  blur 
circle  is  large,  Px  decreases  rapidly  with  increase  of  (k£+k^),  and  the 
high  spatial  frequencies  of  U^x  are  strongly  attenuated.  For  high  res¬ 
olution  (reproduction  of  fine  detail)  the  blur  circle  must  be  small, 
i.e.,  the  optics  must  pass  high  spatial  frequencies.  By  analogy  to 
electrical  filters,  Px  is  called  the  optical  transfer  function.  Ref¬ 
erence  39  is  a  thorough  and  readable  account  of  this  function's  prop 
erties,  measurement,  computation,  and  uses. 

B.  Fourier  Spectra  of  Detector  Response 

Application  of  Eqs.  (33)  and  (36a')  to  Eq.  (19a)  for  a  scanning  de¬ 
tector's  output  gives  for  the  spectrum 


2F{sxKt,yc;T)  ]  -  R\*2F(ux(x,y;T)*«Y(Ct-x,yc-y)  ]  [amps/(micron*rcm*hz)  ] 

-  ^sx<kx'VT)  "  <Rx/t>*°x(kx'VT>*r(kx'ty 

-^Sx<f/^VT)  "  (*VO-ux(fA,ky;T)*r(f/C,ky).  (43a) 

Similarly,  applying  Eqs.  (30)  and  (36b)  to  Eq.  (19b),  one  finds  for  the 
spectrum  of  a  staring  detector's  output 

sx( kx»ky,f )  *  2F{sx(xc,yc,t) ] 

-  Rx*3F{ux(x,y,t°)®«®(Y(xc-x,yc-y)*5(t-t°) J} 

-  Rx*Ux<kx,ky,f) ‘nkjtjky)  [  anps/(  micron*  ran2  *hz)  ] .  (43b) 

In  these  equations  Sx  is  the  spectrum  of  the  output  from  a  single 
detector  element  arbitrarily  located  in  space.  I*(kx,ky)  is  the  fourier 
transform  of  the  detector- response  function  Eq.  (16): 

r(kx,ky)  ■  2F[  y( Xq-x , yc-y ) ]  [cm2  or  ran-2]  (44) 

If  the  detector  is  rectangular,  y  is  given  by  Eq.  (18)  and 

I*(kx,ky)  ■ 

(a'Sincfkjja)  *exp(-i2nkxxc)  ]  •  [b-sinc(kyb)  *exp(-i2iikyyc)  1 ,  (45) 

where  sinc(kxa)  »  (sin  nk^)/^^.  Eqs.  (45)  and  (43)  show  that,  like 
the  optics,  the  detector  filters  spatial  frequencies.  Hence  r  is  called 
the  detector  transfer  function.  As  the  detector  width  (a)  and  height 
(b)  are  increased,  the  first  zeros  of  the  sine  functions  occur  at  lower 
values  of  kx  and  ky,  resulting  in  greater  attenuation  of  higher  spatial 
frequencies  in  the  image  spectra  Ux>  The  detector  usually  attenuates 
the  spatial  frequencies  more  than  any  other  sensor  component. 

C.  Pseudoimage  Spectra 

Eq.  (20a)  for  the  analog  output  of  a  scanning  sensor  is  transformed 
with  the  aid  of  Eqs.  (30)  and  (36a")  to  obtain 

Sxf(f*kyjT)  ■  2F[sxf(x,0;T) ]  ((amps  or  volts )/( micron* ran* hz ) ] 

-  2F[sx(Ct,yc;T)#«[h(T-t)  *5(|3-yc]} 

-  ±Sx(kx,ky)'H(&x)  -  ±Sx(f/Z,ky;T)-H(£).  (46a) 

Using  Eqs.  (30)  and  (36b')  to  transform  Eq.  (20b)  for  a  staring  sensor's 
analog  output  gives 


sXf(kx,ky,f)  ■  3Flsxf(a»e/T) ]  [(amps  or  volts )/( micron* rcm2 • hz ) ] 

-  3F{sx(xc,yc,t)0**[$(a-xc)  *S(e-yc)*h(x-t)  ]} 

-  Sx(kx,ky,f)*H(f).  (46b) 

H(f)  is  the  transfer  function  for  all  analog  processing  of  a  detector 
element's  output  including,  if  applicable,  the  integration  step  of  tem¬ 
poral-integral  sampling.  Sxf  is  the  spectrum  of  analog-processed  output 
from  a  detector  element  located  anywhere  in  space,  or  it  is  the  spectrum 
of  a  pseudoimage,  as  explained  in  the  next  subsection.  The  units  of  SXf 
(asps  or  volts)  are  determined  by  the  units  of  Rx  (amps  or  volts/watt) 
in  Eqs.  (43a,b). 

D.  Synopsis  of  Analog  Spectral  Equations 

Analog  frequency-domain  equations  have  been  derived  stepwise  by 
fourier  transformation  of  the  analog  space-  and  time-domain  equations. 
Each  transformation  gave  a  product  of  two  spectra,  one  representing  a 
physical  process,  the  other  characterizing  the  result  of  all  prior 
processes.  Thus  functions  representing  analog  output  spectra  from 
scanning  and  staring  sensors  are  obtained  by  substituting  Eqs.  (43a,b) 
and  (40a,b)  into  Eqs.  (46a,b)  respectively: 

Sxf<f,ky;T)/*x  -  ^Ubxtf/^kypTj-Pxtf/C.kyJ-nf/C.kyJ-mf) 

■  ^*UbX(  kx,kyjT)  *PX(kx,ky)  •  r(kx,ky)  *H(  Ckx)  (47a) 

( kx,ky, f  )/Bx  *  UbX(kx,ky,f )  *Px(kx,ky)  *r(kx,ky)  *H(f )  (47b) 

The  quantities  an  the  right  sides  of  Eqs.  (47a  and  b)  are  the  apparent 
object-i r radiance  spectrum  (Ufc>X) >  the  monochromatic  optical  transfer 
function  (Px),  the  detector  transfer  function  (D,  and  the  overall 
transfer  function  (H)  for  all  stages  of  linear,  shift-invariant,  analog 
processing.  H  includes  the  effects  of  any  temporal  integration  during 
sanpling.  Eqs.  (39a  and  b)  can  be  used  to  express  UbX  in  terms  of  the 
fourier  spectrum  NfcX  of  the  object  radiance.  S\f  can  be  regarded  as  the 
fourier  spectrum  of  a  pseudoimage,  i.e.,  as  the  spectrum  (UbX'F\)  of  the 
actual  image  modified  by  the  detector  and  analog  transfer  functions,  r 
and  H.  With  detector  responsivity  Rx  in  [volts/watt] ,  typical  units  of 
are  (volts/(micron*rcm*hz)  ]  or  (volts/fmicronTcm^hz)  ]  for  scanning 
or  staring  sensors  respectively. 

E.  Fourier  Spectra  of  Sampled  Pseudoiraages 

Transforming  Eqs.  (24a  and  b)  by  means  of  Eqs.  (30)  and  (37)  gives 
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the  spectra  of  instantaneously  sampled  outputs  from  scanning  and  staring 
sensors: 

Vxf(f,ky;T)  ■  2F[vxf(T,3;T)]  [volts* (  micron*  rcm*hz)“V(  cm*  sec )  ] 


sXf(t,0;T)*  ^  S(x~lAt)*  l  SO-mAy) 

1— *  m— • 


-  Sxf(fM^;T)*|Af^  S[(f-lAf)-f°]j°|Aky  l  S[ (ky-mAky)-k»] j  (48a) 


vXf(kx'ky»£)  *  3y,Ivxf(«»0#T)3  [volts*  (micronTcm^'hzJ^/icm^'sec)  ] 


-  3F 


sXf(a»P*T)  '1  &(«-lAx)  •  ^  &(&-mAy)*  l  S(x-nAT) 


-  Sxf(fcS/Jc£,f°)#|AkxJ^  «[(kx-lAkx)-k»]J 

•Aky]  5[(ky-mAky)-k£]J« 


AF  l  5[ (f-nAF) ]~f°] i  (48b) 


Here  Akx  -  (1/Ax),  Aky  -  (1/Ay),  Af  -  (1/At),  and  AF  -  (1/AT).  The  rep¬ 
licating  property  of  convolution  with  a  delta  function  (ref.  3,  p.  268; 
ref.  4,  p.  79)  can  be  used  to  express  Bqs.  (48a  and  b)  more  compactly  as 
follows: 


Vxftf.ky.-T) 


(Af-Aky)^  2 


Sxf  [  ( f-lAf ) ,  (ky-mAky)  ,*T] 


(49a) 


VXf^X'ky'*)  " 

m 

(Akx*Aky*AF)  HI  Sxf [(kx-lAkx),(ky-fflAky),( f-nAF) J  (49b) 

l,m,rw»-« 


Bqs.  (48a,b)  and  (49a,b)  also  represent  spectra  of  integrally 
sampled  outputs  if  vxf  in  Bqs.  (48a,b)  is  replaced  by  <vxf>  from 
Bqs.  (26a,b). 

Bqs.  (49a,b)  are  the  results  expected  by  analogy  with  the  familiar 
1-D  temporal  case:  The  sampled-output  spectra  V^f  consist  of  replicas 
of  the  pseudoimage  spectra  S\f.  The  replicas  are  separated  by  frequency 
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intervals  ( Af-CAkx,  Aky)  with  a  scanning  sensor  and  (Akx,Aky,AF)  with  a 
staring  sensor.  The  replicas  overlap  and  aliasing  occurs  unless  the 
highest  frequencies  in  S\f  are  less  than  half  the  respective  frequency 
intervals.  As  already  explained,  spatial  integration  of  the  image  by 
the  detector  acts  as  a  low-pass  filter,  and  temporal  integration  of  the 
output  during  sampling  does  the  sane.  Thus  spatial  and  temporal  inte¬ 
gration  reduce  aliasing  of  the  pseudoimage  spectra. 2* 

F.  Fourier  Spectra  of  Sampled  and  Cropped  Pseudoimages 

The  spectrum  of  a  single  instantaneously  sampled  and  cropped  image 
is  obtained  by  transforming  Eq.  (28a  or  b)  with  Eqs.  (30)  and  (37).  The 
image  with  epoch  T  -  0  is  specified  in  the  scanning  case  and  selected  by 
the  cropping  function  in  the  staring  case.  The  results  are  as  follows: 

Vxf(f  fky;^-0)  e  2f(\v^£(x,S;T-0)\)  [volts- (micron-rcm-hz)-1/(cm-sec)  ] 

-  2,[^« x. a,™ , •  cct . ctot ] 

-  Vxf<f«,k$;T-0) 

•  { ( VAf )  *  sinc[  ( f-f • )  ( VAf )  ]  *  exp[  -i  it(  f-f1 • )  ( L-l  )/Af  ] } 

•{  (li/Aky)  -sincl  (ky-k£)  (H/bky)  ]  -exp[-in(ky-k£)  (M-l)/aky] }  (50a) 

■  3F[\vxf(a,0fx)\J  l  volts -(micron- ran2 -hz)“V(  cm2- sec )  1 

-  3F [vxf  ( a, 0,t)  •  rect  . rect  .  rect ( t/AT ) ] 

-  VxfOc^Jtyf) 

• { ( L/& kx ) • sincl ( kx-k£ ) ( L/Akx ) ) • exp[-i s( kx-k£ ) ( L-l )/Akx ] ) 

•{  (H/Aky)  -sinc(  (ky-k^)  (H/Aky) )  -exp(-iJi(ky-k£)  (n-l)/Aky] ) 
•{(1/AF) -sincl  (f-f*)/AFH  (50b) 

The  complex  exponential  phase  factors  in  these  equations  can  be  elimi¬ 
nated  by  centering  the  rectangle  functions  on  the  origin,  but  then  the 
lower  limits  of  the  corresponding  spatial  and  temporal  sums  are  negative 
instead  of  zero. 

Substituting  V^f( f°,k£;T-0)  and  V^f (kx,k£,f# )  from  Eqs.  (49a, b) 
into  Eqs.  (50a,b)  gives  the  following  more  informative  expressions  for 


Vxf<f,ky;T-0)  -  (L-M)  l  l  S\f ( ( f°-lAf ) , (ky-mAky) ;T»0] 

1#®"  9 

•{sinc[ ( f-f° ) ( L/Af ) ] -exp[-in( f-f 9 ) (L-1)/Af ) } 

•  { sine  [  ( ky-k£ )  ( VAky ) )  *  exp  [— in(  ky-k£ )  ( M-l )  /Aky  ] }  ( 51a ) 

m 

V\f(kx,ky,f)  -  (L-M)  III  Sxf[(k9-lAJcx),(k9-mAky),(f9-nAF)] 

l,m,n— • 

♦  { sine!  ( kx-k£ )  { L/Akx ) )  •  exp[  -i  it(  kx-k£ )  ( L-l  )/Akx  ] } 

•{sinct  (ky-k^)  OVAky)  1  *exp[-in(ky-k^)  (M-1)/Aky] } 
•sinc((f-f°)/AF]  (51b) 

Eqs.  (51a  and  b)  state  that  truncating  the  sensor  output  broadens  and 
distorts  ("ripples")  the  pseudoimage  spectra  S\f  by  convolving  them  with 
the  transforms  of  the  cropping  functions.  The  broadening  worsens  the 
effects  of  aliasing  in  the  sampled  and  cropped  output.  Recording  large 
images  (making  L  and  M  large)  moves  the  first  zeros  of  the  corresponding 
sine  functions  to  lower  frequencies  and  reduces  broadening  along  the  as¬ 
sociated  frequency  axes.  Recording  many  images  from  a  stare r  similarly 
reduces  broadening  along  the  temporal  frequency  axis  since  ( N/AF )  re¬ 
places  (1/AF)  in  Eq.  (50b). 

Eqs.  (50a,b)  and  (51a,b)  also  represent  spectra  of  integrally  sam¬ 
pled  and  cropped  outputs  if  \v^f\  is  replaced  in  Eqs.  (50a,b)  by  \<v^f>\ 
from  Eqs.  (29a, b). 


Fig.  2  — Zero-one  response  functions,  Eqs.  (16)  and  (18), 
for  arbitrarily-shaped  and  rectangular  detectors  with  constant 
responsivity  on  their  surfaces  S.  Note  distinction  between 
inage  (x,y)  and  detector-center  (xc,yc)  variables. 


Sample 


«•— •— H 


(a)  Staring  Sensor 


•  •  •  •  • 


(b)  Scanning  Sensor 

Fig.  3  —  Sanqpling  geometries  for  staring  and  scanning 
sensors  with  channel  offsets  removed  from  scanner  output. 


APPENDIX  A.  2-D  Fourier  Transform  of  a  Convolution, 


To  simplify  notation  let  J and 


r2 

c(tt,yc;T)  ■  I  g(x,y;T) *w( Ct-x,yc-y) -dxdy. 


Then  from  Eq.  (30) 


2F[c] 


-  J*{|W 


;T)  •  w(  Ct-x,yc-y)  *dxdy  ^exp(-i2n(  ft+kyyc)  ]  *dtdyc.  (A2 


Change  the  order  of  the  double  integrations. 


2Ftc] 


-  jV.y;T>jj‘ 


w(Ct-x,yc-y)  •exp(-i2n(ft+kyyc)  ]*dtdyc>*dxdy.  (A3 


Multiply  the  outer  integrand  by  1 


exp(-i2«(kxx+kyy) ] *exp[-i2Jt(-kxx-kyy) ] 


2F(c]  -  J  g(x,y;T)-exp[-i2re(kxx+kyy)] 


jj  w( Ct-x,yc-y) *exp(-i2n( ft+kyyc) ] -dtdyc|* 

exp[-i2n(-kxx-kyy) ] *dxdy.  (A4 
Combine  the  final  exponential  with  the  inner  integrand. 

2F(c]  -  J  g(x,y;T)*exp[-i2n(kxx+kyy)]* 

jj  w( £t-x,yc-y) *exp{-i2a{ ( ft-kxx)+ky(yc-y) ] ) *dtdyc|'dxdy.  (A5 

Substitute  f-Ckx,  Ct«xc,  and  dt-dXc/C  into  the  inner  double  integral. 
2F[c]  -  |  g(x,y;T) -exp(-i2n(kxx+kyy) ] •  (A6 

|z*J  w(xc-x'Yc~y'>  -exp{-i2it[kx(xc-x)+ky(yc-y)  ] )  -dxcdycj-dxdy. 

Change  the  inner  variables  of  integration  to  X*(xc-x),  Y-(yc-y),  and  re 
group  the  terms  of  the  outer  double  integral. 


,»  ».»  v*  !,*  1  ' 


APPENDIX  B.  3-D  Fourier  Transform  of  a  Product, 


The  inner  integrals  are  the  fourier  spectra  of  q(x),  w(y),  and  z(t). 

3F[ p]  -  J3G{kJ,k^,f)-{Q(kx-k5)-W(ky-k^)-Z(f-f°)]-dk»dk^df8  (B6) 

This  3-D  convolution  can  be  written  symbolically  in  two  ways: 

3F[ p }  -  G(k',k',f0)O99(Q(kx-k°)-W(ky-k$)-Z(£-£0)J  (B7) 

-  G<k£,kJ,f8)*Q(kx-k8)^(ky-k£)®Z(f-f8)  (37) 
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APPDCIX  c.  Equivalence  of  Projection-Slice  and  Present  Analyses 

when  the  Former  Applies 


Using  a  projection-slice  approach,  reference  9  derives  relations 
for  the  output  and  its  spec true  froe  a  scanning  sensor.  Here  acre  gen¬ 
eral  relations  are  derived  differently.  If  both  approaches  are  correct, 
they  should  give  the  saee  result  when  both  are  applicable.  This  appen¬ 
dix  demonstrates  the  equivalence.  The  simpler  projection-slice  approach 
is  preferable  for  treating  output  froa  a  single  detector  or  frosi  a  two- 
dimensional  spatial  filter.8  The  present  analysis  is  better  for  dealing 
with  images. 


For  comparison  of  the  two  approaches,  results  of  this  analysis  aust 
be  rewritten  using  the  notation  and  conventions  of  reference  9.  The 
space,  time,  and  frequency  coordinates  are  the  seam  in  the  two  vorks,  as 
are  the  fourier-transform  definitions  except  for  the  minor  notational 
difference  ?2  ■  *f.  use  of  normalised  scale  factors  in  reference  9  cor¬ 
responds  to  projecting  the  image  ir radiance  distribution  ideally  onto 
the  object  plane,  as  in  the  present  work.  The  "intensity  image  distri¬ 
bution  function"  of  reference  9  is  the  same  as  the  "image  ir  radiance 
distribution"  of  this  work.  Conversions  for  other  quantities  are: 

(o-Ufcx*  OUbx)  (h*-PX'  Hs-*X>  (d-T'  1>r) 

(i'-sx/Rx,  I'-S>/!lx)  <»-*X'  *<'  «*2Tf) 

lv<t)-SxfU*'*-°>'  H(«)-Sxf<f*’^°)l 

The  two  conversions  in  brackets  apply  when  there  is  no  analog  processing 
-  i.e.,  lh(r-t)-4(T-t) ,  H(f)-1]  -  and  voltage  units  are  used  for  detec¬ 
tor  responsivity.  Further  differences  between  the  notation  of  reference 
9  and  this  work  are  as  follows:  Here  P  is  the  optical  transfer  func¬ 
tion,  in  reference  9  it  is  the  projection  of  I'  on  y*-0 .  A  prism  denotes 
any  image-plane  quantity  in  this  work,  in  reference  9  it  indicates  image 
ir radiance  convolved  with  the  detector  function  d-y.  Finally,  reference 
9  does  not  distinguish  between  different  temporal  quantities  such  as 
(t,x,T)  or  different  spatial  quantities  such  as  (x,y),  (xc,yc),  (<*,fl). 


The  key  results  of  reference  9  are  now  derived  from  the  results  of 
the  present  work.  From  Eqs.  (20a),  (31),  and  (46a) 

sxf<T*0>  "  -2F(SXf(f,ky)] 

m 

-  JJ  £/Z,ky)  *H( f ) *exp( i2s( fr+kytf)  J -dfdky.  *  Cl ) 
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Substitution  of  f-Ckx  and  H( f )«H( Ckx) ,  some  rearrangement,  and  defini¬ 
tion  of  a  new  quantity  give 


•\f<x,S)  •  J  H(Ckx)‘Pr(kx,0)*exp(i2»ikxCx)*dkx,  (C2) 

where  Pr(kx,S)  is  the  projection  of  S\  on  y-0: 

m 

Pr(kx,d)  ■  J  Sx(kx,ky}*exp(i2nkyd)*dky.  (C3) 

It  follows  from  the  definitions  of  independent  coordinates,  functions, 
and  equality  that 

*Xf(T;(5-0)  -  J  H(Ckx)*Pr(kx;(J-0)*exp(i2idtxCx)*dkx.  (C4) 

(Since  all  coordinates  are  independent,  any  can  be  fixed  at  an  arbitrary 
value  without  regard  to  the  others,  and  the  value  must  be  the  same  on 
the  two  sides  of  the  functional  equality.)  When,  as  in  reference  9, 
there  is  no  analog  processing,  B(Ckx)  -  H(f)  -  1  and 

m 

•Xf<T»*^)  "  J  Pr(kx;3-0)*exp(i2RkxCx)*dkx.  (C5) 

With  the  appropriate  conversions  this  becomes  Eq.  (9)  of  reference  9: 

m 

v(t)  -  R*  J  P(kx) •exp(i2skxbt) -dkx  -  R*i'(bt,0)  Ref.  9,  Eq.  (9) 


Fourier  transforming  Eq.  (C5)  using  Eq.  (30)  gives 
Sxf(f;6-0)  -  1P(sXf(x;e-0)) 


•J 


J  Pr(kx;^0)  *exp(  i2ixkxCT)  *dkx 


■exp(-i2nf-c) -dx. 


(C6) 


After  substituting  f-Ckx,  a^Cx,  and  recalling  that  (a,kx)  are  conjugate 


variables,  one  obtains 


Sxf(f;M))  -  i-J 


J  Pr(kx;0-O)  *exp(i2Jikxa)  *dkx] 


•exp(-i2nkxa)  *da 


-  ^•1F{-1F[Pr(kx;0-O)]}  -  ~Pr(kx;|3-0).  (C7) 

On  conversion  of  notation  the  last  equality  becomes 

H(<d)  -  ~P(kx)  -  ~P(<V2nb).  (C8) 

This  agrees  with  Eq.  (10)  of  reference  9  when  typographical  errors  in 
that  equation  are  corrected  by  derivation  as  follows. 


H(u>)  -  J  v(t) *exp(-iwt) *dt  -  g*J  i' (x,0)  ‘expC-ilnkxX) *dx 


-II 


J  P(kx) *exp(i2nkxx) *dx 


•exp(-i2itkxx)  *dx  -  g*Fi{FJ1[P(kx)  ] } 


-  |*P(kx)  -  j~P(e*/2nb) 


Ref.  9,  Eq.  (10) 
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